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Summary. In this paper the issue of energy efficiency in CDMA wireless data 
networks is addressed through a game theoretic approach. Building on a recent 
paper by the first two authors, wherein a non-cooperative game for spreading-code 
optimization, power control, and receiver design has been proposed to maximize 
the ratio of data throughput to transmit power for each active user, a stochastic 
algorithm is here described to perform adaptive implementation of the said non- 
cooperative game. The proposed solution is based on a combination of RLS-type and 
LMS-type adaptations, and makes use of readily available measurements. Simulation 
results show that its performance approaches with satisfactory accuracy that of the 
non-adaptive game, which requires a much larger amount of prior information. 



1 Introduction 

Game theory [1] is a branch of mathematics that has been applied primarily 
in economics and other social sciences to study the interactions among several 
autonomous subjects with contrasting interests. More recently, it has been dis- 
covered that it can also be used for the design and analysis of communication 
systems, mostly with application to resource allocation algorithms [2], and, in 
particular, to power control [3]. As examples, the reader is referred to [4, 5, 6]. 
Here, for a multiple access wireless data network, noncooperative and coop- 
erative games are introduced, wherein each user chooses its transmit power 
in order to maximize its own utility, defined as the ratio of the throughput to 
transmit power. While the above papers consider the issue of power control 
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assuming that a conventional matched filter is available at the receiver, refer- 
ence [7] considers the problem of joint linear receiver design and power control 
so as to maximize the utility of each user. It is shown here that the inclusion 
of receiver design in the considered game brings remarkable advantages, and, 
also, results based on the powerful large-system analysis are presented. More 
recently, the results of [7] have been extended in [8] to the case in which also 
each user's spreading code is included in the tunable parameters for utility 
maximization. The study [8] thus shows that significant performance gains 
can be obtained through the joint optimization of the spreading code, the 
transmit power and the receiver filter for each user. 

On the other hand, the solutions proposed in [7] and [8], while providing a 
general framework for cross-layer resource optimization through a game the- 
oretic approach, describe solutions based on a perfect knowledge of a number 
of parameters such as the spreading codes, the transmit powers, the propa- 
gation channels and the receive filters for all the users. Otherwise stated, the 
optimization procedure for each user requires a vast amount of prior infor- 
mation not only for the user of interest, but also for all the remaining active 
users. In this paper, instead, we consider the more practical and challeng- 
ing situation in which each user performs utility maximization based on the 
knowledge of its parameters only, i.e. assuming total ignorance of the interfer- 
ence background. This may be the usual scenario in the downlink of a wireless 
data network, as well as in the uplink of a multicell wireless network, wherein 
each access point (AP) is disturbed by the interference originating from users 
served by surrounding AP's. An adaptively learning algorithm capable of ap- 
proaching with good accuracy the performance of the non-adaptive game is 
thus presented, based on a combination of the recursive-least-squares (RLS) 
and least-mean-squares (LMS) adaptation rules. The proposed algorithm as- 
sumes no prior knowledge on the interference background and makes use of 
readily available measurements. 

The rest of this paper is organized as follows. The next section contains 
some preliminaries and the system model of interest. Section 3 contains a 
brief review of the non-adaptive game considered in [8] , while the stochastic 
implementation of the resource allocation algorithm is detailed in Section 
4. Section 5 contains extensive simulation results, while, finally concluding 
remarks are given in Section 6. 

2 Preliminaries and problem statement 

Consider the uplink of a JT-user synchronous, single-cell, direct-sequence code 
division multiple access (DS/CDMA) network with processing gain N and 
subject to flat fading. After chip-matched filtering and sampling at the chip- 
rate, the TV-dimensional received data vector, say r, corresponding to one 
symbol interval, can be written as 
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K 

r = ^2VPk h khs k +n , (1) 

fc=i 

wherein pk is the transmit power of the fc-th user 3 , bk G { — 1,1} is the in- 
formation symbol of the fc-th user, and hk is the real 4 channel gain between 
the fc-th user's transmitter and the access point (AP); the actual value of hk 
depends on both the distance of the fc-th user's terminal from the AP and 
the channel fading fluctuations. The TV-dimensional vector Sk is the spread- 
ing code of the fc-th user; we assume that the entries of Sk are real and that 
s^Sfc = ||sfc|| 2 = 1, with (-) T denoting transpose. Finally, n is the ambient 
noise vector, which we assume to be a zero-mean white Gaussian random pro- 
cess with covariance matrix (A/o/2)Jjv, with 1^ the identity matrix of order 
N. An alternative and compact representation of (1) is given by 

r = SP 1/2 Hb + n , (2) 

wherein S — [s\, . . . , sk] is the N x if-dimensional spreading code matrix, 
P and H are K x if-dimensional diagonal matrices, whose diagonals are 
[pi, . . . ,Pk] and [hi, ... , hx\, respectively, and, finally, b — [b\, . . . , 6ff] T is 
the if-dimensional vector of the data symbols. 

Assume now that each mobile terminal sends its data in packets of M 
bits, and that it is interested both in having its data received with as small as 
possible error probability at the AP, and in making careful use of the energy 
stored in its battery. Obviously, these are conflicting goals, since error-free 
reception may be achieved by increasing the received SNR, i.e. by increasing 
the transmit power, which of course comes at the expense of battery life 5 . A 
useful approach to quantify these conflicting goals is to define the utility of the 
fc-th user as the ratio of its throughput, defined as the number of information 
bits that are received with no error in unit time, to its transmit power [4, 5], 
i.e. 

u k = — . (3) 

Pk 

Note that u k is measured in bit/Joule, i.e. it represents the number of suc- 
cessful bit transmissions that can be made for each Joule of energy drained 
from the battery. Denoting by R the common rate of the network (extension 

3 To simplify subsequent notation, we assume that the transmitted power pk sub- 
sumes also the gain of the transmit and receive antennas. 

4 We assume here, for simplicity, a real channel model; generalization to practical 
channels, with I and Q components, is straightforward. 

5 Of course there are many other strategies to lower the data error probability, 
such as for example the use of error correcting codes, diversity exploitation, and 
implementation of optimal reception techniques at the receiver. Here, however, 
we are mainly interested to energy efficient data transmission and power usage, 
so we consider only the effects of varying the transmit power, the receiver and 
the spreading code on energy efficiency. 
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to the case in which each user transmits with its own rate Rk is quite simple) 
and assuming that each packet of M symbols contains L information symbols 
and M — L overhead symbols, reserved, e.g., for channel estimation and/or 
parity checks, the throughput 7\ can be expressed as 

Tk = R^Pk (4) 

wherein P k denotes the probability that a packet from the fc-th user is received 
error- free. In the considered DS/CDMA setting, the term Pk depends formally 
on a number of parameters such as the spreading codes of all the users and 
the diagonal entries of the matrices P and H , as well as on the strength of the 
used error correcting codes. However, a customary approach is to model the 
multiple access interference as a Gaussian random process, and assume that Pk 
is an increasing function of the fc-th user's Signal-to-Interference plus Noise- 
Ratio (SINR) 7^, which is naturally the case in many practical situations. 

Recall that, for the case in which a linear receiver is used to detect the 
data symbol b k , according, i.e., to the decision rule 



b k = sign d[r 



(5) 



with bk the estimate of bk and dk the iV-dimcnsional vector representing the 
receive filter for the user k, it is easily seen that the SINR -fk can be written 

as 

7fe = njMlhf. . (6 ) 

Of related interest is also the mean square error (MSE) for the user k, which, 
for a linear receiver, is defined as 



MSE 



fc = E { (b k - 4rj 2} = 1 + d T k Md k - 2^k~h k d T k s k , (7) 

wherein E {■} denotes statistical expectation and M = (SHPH T S T + ^In^J 
is the covariance matrix of the data. 

The exact shape of Pk{"lk) depends on factors such as the modulation 
and coding type. However, in all cases of relevant interest, it is an increasing 
function of 7^ with a sigmoidal shape, and converges to unity as jk — * +00; as 
an example, for binary phase-shift-keying (BPSK) modulation coupled with 
no channel coding, it is easily shown that 

r -i M 

Pk{lk) = [l-Q(^/Wk)\ , (8) 

with Q(-) the complementary cumulative distribution function of a zero-mean 
random Gaussian variate with unit variance. A plot of (8) is shown in Fig. 1 
for the case M = 100. 
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It should be also noted that substituting (8) into (4), and, in turn, into 
(3), leads to a strong incongruence. Indeed, for — > 0, we have jk — * 0, but 
Pk converges to a small but non-zero value (i.e. 2 _M ), thus implying that an 
unboundedly large utility can be achieved by transmitting with zero power, 
i.e. not transmitting at all and making blind guesses at the receiver on what 
data were transmitted. To circumvent this problem, a customary approach 
[5, 7] is to replace Pk with an efficiency function, say /fc(7&), whose behavior 
should approximate as close as possible that of Pk, except that for jk — » 
it is required that fk(jk) — °(lk)- The function /(7k) = (1 — e~ lk ) M is a 
widely accepted substitute for the true probability of correct packet reception, 
and in the following we will adopt this model 6 . This efficiency function is 
increasing and S-shaped, converges to unity as jk approaches infinity, and has 
a continuous first order derivative. Note that we have omitted the subscript 
"fc", i.e. we have used the notation f(-fk) in place of fk{lk) since we assume 
that the efficiency function is the same for all the users. 

Summing up, substituting (4) into (3) and replacing the probability Pk 
with the above defined efficiency function, we obtain the following expression 
for the fc-th user's utility: 

u k = R±-^-, Vk = l,...,K. (9) 



P and efficiency function, M=100 



f 




01 23456789 10 



Fig. 1. Comparison of probability of error- free packet reception and efficiency func- 
tion versus receive SINR and for packet size M = 100. Note the S-shape of both 
functions. 



See Fig. 1 for a comparison between the Probability Pk and the efficiency function. 
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3 The non-cooperative game with linear receivers 

Based on the utility definition (9), it is natural to wonder how each user may 
maximize its utility, how this maximization affects utilities achieved by other 
users, and, also, if a stable equilibrium point does exist. These questions have 
been answered in recent papers by resorting to the tools of game theory. As an 
example, non-cooperative scenarios wherein mobile users are allowed to vary 
their transmit power only have been considered in [4, 5, 6]; in [7], instead, 
such an approach has been extended to the cross layer scenario in which each 
user may vary its power and its uplink linear receiver, while, more recently, 
reference [8] has considered the case in which each user is able to tune the 
transmit power, the uplink linear receiver and the adopted spreading code. 

Formally, the game Q considered in [8] can be described as the triplet 
Q = [K,, {Sk} , {uk}], wherein K, — {1,2, ... ,K} is the set of active users 
participating in the game, Uk is the fc-th user's utility defined in (9), and 

S fe = [0,P fe , max ]xft w x^, (10) 

is the set of possible actions (strategies) that user k can take. It is seen that 
Sk is written as the Cartesian product of three different sets, and indeed 
[0,-Pfc, max ] is the range of available transmit powers for the fc-th user (note 
that Pfc,max is the maximum allowed transmit power for user k), 1Z N , with 1Z 
the real line, defines the set of all possible linear receive filters, and, finally, 

1Z? = {dell N : d T d=l) , 

defines the set of the allowed spreading codes 7 for user k. 

Summing up, the proposed noncooperative game can be cast as the fol- 
lowing maximization problem 

maxufe — max Uk(pk,dk,Sk) , Vk = l,...,K. (11) 

Given (9), the above maximization can be also written as 

max tt^ , Vk = l,...,K. (12) 
Pk ,d k ,s k Pk 

Moreover, since the efficiency function is monotone and non-decreasing, we 
also have 

/ max j k (pk,d k ,s k ) 
f('jk(pk,dk,Sk)) \d k ,s k J 

max = max — — , (13) 

Pk ,d k ,s k Pk Pfc Pk 



7 Here we assume that the spreading codes have real entries; the problem of utility 
maximization with reasonable complexity for the case of discrete-valued entries 
is a challenging issue that will be considered in the future. 
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i.e. we can first take care of SINR maximization with respect to spreading 
codes and linear receivers, and then focus on maximization of the resulting 
utility with respect to transmit power. 

Letting (•)+ denoting Moore-Penrose pseudoinverse, the following result is 
reported in [8]. 

Proposition: The non-cooperative game defined in (11) admits a unique Nash 
equilibrium point (p k , d k , s* k ), for k = 1, . . . , K, wherein 

s* k and d k are the unique fixed stable k-th user spreading code and receive 
filter 9, resulting from iterations 



with in such that ||si|| 2 = 1, and D = [si, ... ,8k]- Denote by 7^ the 
corresponding SINR. 
- p* k = mm{p k , Pfc jmax }, with pk the k-th user transmit power such that 
the k-th user maximum SINR 7^ equals 7, i.e. the unique solution of the 
equation /(7) = 7/' (7), with f'("f) the derivative of f("f). 

In practice, this result states that the non-cooperative game (11) admits 
a unique Nash equilibrium, that can be reached as follows. First of all, the 
equation / (7) = 7/' (7) is to be solved in order to determine its unique solution 
7; then, an iterative procedure starts wherein the system alternates between 
these two phases: 

a. Given the transmit powers, each user adjusts its spreading code and receive 
filter through iterations (14) until an equilibrium is reached; 

b. Given the spreading codes and uplink receivers, each user tunes its trans- 
mit power so that its own SIR equals 7. Denoting by p = [pi, . . . ,pk] 
the users' power vector, and by I(p) the i^-dimensional vector whose fc-th 
entry Ik(p) is written as 



the transmit power vector p is the unique fixed stable point of the iteration 




(14) 




(15) 



[3] 



Pk = 




for I k (p) < 
for J fc (p) > P fe , 



max 1 



max i 



(16) 



for all k = 1, . . . , 



K. 



8 



Actually the linear receive filter is unique up to a positive scaling factor. 
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Steps a. and b. are to be repeated until convergence is reached. It is crucial to 
note that computation of the equilibrium transmit power, spreading code and 
linear receiver for each user needs a lot of prior information. In particular, 
it is seen from cq. (14) that computation of the k-th user receiver requires 
knowledge of the spreading codes, transmit powers and channel gains for all 
the active users, while computation of the fc-th user spreading code requires 
knowledge of D, i.e. the matrix of the uplink receivers for all the users. Like- 
wise, implementation of iterations (16) also requires the same vast amount 
of prior information. Our next goal is thus to propose a stochastic resource 
allocation algorithm that alleviates the need for such prior knowledge, and 
that is amenable to a decentralized implementation, wherein each user may 
allocate its own resources based only on knowledge that is readily available, 
and with total ignorance on the interference background. 

4 Adaptive energy efficient resource allocation 

In order to illustrate the adaptive implementation of the non-cooperative 
game, a slight change of notation is needed. Indeed, since any adaptive al- 
gorithm relics on several data observations in consecutive symbol intervals, 
we cannot restrict any longer our attention to one symbol interval only, and 
we thus denote by r(n) the iV-dimensional received data vector in the n-th 
bit interval, i.e. 

K 

r ( n ) = VPk(n)h k b k (n)s k (n) + w(n) . (17) 
fe=i 

Eq. (17) differs from Eq. (1) in that a temporal index has been added to some 
parameters, to underline their time- varying nature: as an example, p k (n) and 
s k (n) are the transmit power and the spreading code of the fc-th user in the n- 
th symbol interval. Note also that the channel gain does not depend on n, i.e. 
we are implicitly assuming a slow fading channel, even though generalization 
to the case of slowly time- varying channels is quite straightforward. In order 
to obtain an adaptive implementation of the utility maximizing algorithm for 
the generic fc-th user, first we focus on iterations (14); as specified in [8, 9], 
the unique fixed stable point of these iterations achieves the global minimum 
for the total mean square error (TMSE), which is given by 

K 

TMSE = MSE fe . ( 18 ) 
fe=i 

with MSEfc defined as in (7). It can be shown, indeed, that minimization of the 
TMSE leads to a Pareto-optimal solution to the problem of maximizing the 
SINR for each user. On the other hand, an alternative approach is to consider 
the case in which each user tries to minimize its own MSE with respect to its 
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spreading code and linear receiver. The fc-th user MSE can be shown to be 
written as 

MSE fe = 1 + dl (p k h 2 k s k sl + M fc ) d k - 2 s /p^h k d t k s k , (19) 

with M k = M — pkh^SksJ. Minimization of Eq. (19) with respect to d k and 
s k , under the constraint ||sfc|| 2 = 1, yields the iterations 

d % = Jplhi (SHPH T S T + &I N ) Si Vi = 1, . . . , K 

) T l-i J (20) 

s i = y/Plhi [pihjdidi +HiI N \ di \/i = l,...,K 

In general, minimization of the TMSE is not equivalent to individual mini- 
mization of the MSE of each user; however, in our scenario, i.e. in the case of 
a single-path fading channel, the two approaches can be shown to be equiv- 
alent [10]. As a consequence, we can state that the fixed point of iterations 
(14) coincides with that of iterations (20). Note however that, despite such 
equivalence, the spreading code update for each user in (20) depends only on 
parameters of the user itself, and docs not require any knowledge on the inter- 
ference background. The receiver updates in (14) and (20) are the same, and 
indeed they coincide with the MMSE receiver. Accordingly, since the utility 
maximizing linear receiver is the MMSE filter, we start resorting to the well- 
known recursive-least-squares (RLS) implementation of this receiver. Letting 
R(0) = cIn, with e a small positive constant, letting A be a close-to-unity 
scalar constant, assuming that the receiver has knowledge of the information 
symbols 6^(1), . . . ,b k (T), and denoting by d k (n) the estimate of the linear 
receiver filter for the fc-th user in the n-th symbol interval, the following iter- 
ations can be considered 

= R-\n-l)r{n) 
y ' \ + r T (n)R-\n- l)r(n) ' 
R- 1 (n) = j[R- 1 (n-l)-k(n)r T (n)R- 1 (n-l)] , ^ 

e k (n) = dfe(n - l)r(n) - b k (n) , 
dfc(n) = d k {n - 1) - e k (n)k(n) . 

The last line in (21) represents the update equation for the detection vector 
dfc(-). Note that this equation, in turn, depends on the error vector e k (n), 
which, for n < T, can be built based on the knowledge of the training symbol 
b k (n). Once the training phase is over, real data detection takes place and the 
error in the third line of (21) is computed according to the equation 



e k (n) = dl(n-l)r(n)-sgn d£(n - l)r(n) . (22) 



■T i 



Given its own receive filter d k {n), the fc-th user can then modify its spreading 
code according to the second line of eq. (20), i.e.: 
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s k (n + 1) = \/p k {n)h k (p k (n)h k d k (n)dl(n) + n k (n)I N ^J d k (n) , (23) 

with p k (n) a constant such that sj (n)s k (n) = 1. Note that the update in (23) 
only requires parameters of the fc-th user, thus implying that no knowledge 
on the interference background is needed. Finally, we have to consider the 
tuning of the transmit power so that each user may achieve its target SINR 
7. This is a classical stochastic power control problem that has been treated, 
for instance, in [11]. A possible solution is to consider a least- mean-squares 
(LMS) update of the trasmit power according to the rule 

p k (n + 1) = (1 - p)pk{n - 1) + ph(n) , 
Pk(n+ 1) = min(p fe (n+ l),P fe , max ) • 

In the above equations, the step-size p is a close-to-zero positive constant and 
2fc(n) is a stochastic approximation of the fc-th entry of the vector I(p), and 
is expressed as 

W = u ,jT,\ , » 2 \{d T k {n)r{n)f - p k in)h\{d T k (n)s k (n)) 2 ] (25) 
h k {d k {n)s k {n)Y L J 

Note that also the update (24) does not require any knowledge on the inter- 
ference. To summarize, the algorithm proceeds as follows: for n <T, only the 
RLS update (21) is performed; then, for each n > T, the algorithm performs 
the updates in (21), (23) and, finally, (24). In particular, note that the power 
update is made in parallel to the spreading code update and receiver update, 
i.e. without waiting for convergence of the RLS-based adaptive implementa- 
tion of the MMSE receiver. 

Although a theoretical convergence study of this algorithm is definitely 
worth being undertaken, it is out of the scope of this paper; in the next 
section, we will discuss the results of extensive computer simulations that will 
show the excellent behavior of the outlined procedure. 



5 Numerical Results 

We contrast here the performance of the non-adaptive game discussed in 
[8] with its adaptive implementation proposed here. We consider an uplink 
DS/CDMA system with processing gain N = 15, and assume that the packet 
length is M = 120. for this value of M the equation f(j) = 7/' (7) can be 
shown to admit the solution 7 = 6.689 = 8.25dB. A single-cell system is con- 
sidered, wherein users may have random positions with a distance from the 
AP ranging from 10m to 500m. The channel coefficient h k for the generic fc-th 
user is assumed to be Rayleigh distributed with mean equal to d^ 2 , with d k 
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AVERAGE UTILITY(dB), N = 15 




Fig. 2. Achieved average utility versus time. 
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Fig. 3. Achieved average SINR versus time. 



being the distance of user k from the AP 9 . We take the ambient noise level 
to be Afo — 10 _5 W/Hz, while the maximum allowed power Pk,max is 25dB. 
We present the results of averaging over 1000 independent realizations for the 

9 Note that we are here assuming that the power path losses are proportional 
to the fourth power of the path length, which is reasonable in urban cellular 
environments. 
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AVERAGE TRANSMIT POWER (dB), N = 15 
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500 1000 1500 2000 2500 
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Fig. 4. Average transmit power versus time. 



users locations, fading channel coefficients and starting set of spreading codes. 
More precisely, for each iteration we randomly generate an N x if-dimensional 
spreading code matrix with entries in the set | — 1/ \/N, 1 / \/~N j ; this matrix 

is then used as the starting point for the considered games. We consider the 
case in which T — 80 training symbols are used, while in eq. (24) the step size 
p = .01 has been taken. Figs. 2-4 report the time-evolution of the achieved 
average utility (measured in bit /Joule), the average achieved SINR and the 
average transmit power, respectively, for both the cases in which K — 8 and 
K = 14. It is seen that after about one thousand iterations the adaptive algo- 
rithm approximate with satisfactory accuracy the benchmark scenario that a 
non-adaptive game is played as in [8]. In particular, while the target SINR and 
the achieved utility are quite close to their target values, it is seen from Fig. 4 
that the average transmit power is about 3dB larger than in the non-adaptive 
case; such a loss is not at all surprising, since it is well-known that adaptive 
algorithms have a steady-state error, and that their performance may only 
approach that of their non-adaptive counterparts. 

In order to test the tracking properties of the proposed algorithm, we 
also consider a dynamic scenario with an initial number of users K = 8, and 
with two additional users entering the channel at time epochs n = 1000 and 
n = 1700. The results are reported in Figs 5-7. Results clearly show that the 
algorithm is capable of coping with changes in the interference background. 
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AVERAGED UTILITY, N = 15, initial K= 8 




Fig. 5. Dynamic environment: Average achieved utility versus time. 



AVERAGED ACHIEVED SINR(dB), N = 15, initial K = 8 
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Fig. 6. Dynamic environment: Average achieved SINR versus time. 



6 Conclusion 



In this paper the cross-layer issue of joint stochastic power control, spread- 
ing code optimization and receiver design for wireless data networks has been 
addressed using a game-theoretic framework. Building on [8] , wherein a non- 
cooperative game for resource allocation has been proposed, we have here 
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AVERAGED TRANSMIT POWER (dB), N = 15, initial K=8 
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Fig. 7. Dynamic environment: Average transmit power versus time. 

considered the issue of adaptive implementation of the resource allocation 
algorithm, based on readily available measurements and assuming no prior 
knowledge on the interference background. The result is thus a stochastic al- 
gorithm that can be realized in a decentralized fashion, wherein each user 
just needs knowledge of its own parameters. The performance of the proposed 
scheme has been validated through computer simulations, which showed that 
the adaptive implementation achieved a performance quite close to that of the 
non-adaptive benchmark. As interesting research topics worth being investi- 
gated we mention the theoretical analysis of the convergence properties of the 
algorithm, and the development and the analysis of adaptive algorithms able 
to implement the said game without prior knowledge of the fading channel 
coefficient of the user of interest. 
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